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Analogical Reasoning: 
A Review of the literature 

Rene* V. Dawis and Luis T. Siojo 
University of Minnesota 

The analogy, or analogical reasoning, test has played a prominent part 
in the history of intelligence testing. It was first introduced in the fa- 
miliar a:b::c:d form by Burt (1911), who also first used the term "analogies". 
Woodworth and Wells (1911) at about the same time had attempted to use the 
analogical relations in an association test of flexibility of mental perfor- 
mance and "skill in handling associations." Whipple (1915) listed "analo- 
gies" in his classic Manual of Mental and Physical Tests as a measure of com- 
plex processes (tests of association, learning and memory). The analogy test 

I 

was included as a subtest in the Army Alpha of the World War I period. Yerkes 
(1921) identified Thurstone, Otis and Bingham as responsible for development 
of the subtest. Subsequently, Thurstone (1919) used analogies in his pio- 
neering work on college entrance tests; Otis (1919) included analogies as a 
subtest of the Otis Group Intelligence Scale; Yerkes, Bridges and Hardwick 
(1915) used analogies in their Point Scale; Thorndike (1919) used pictorial 
and geometric analogies in his Non-Verbal Intelligence Scale; Thurstone (1930) 
used an analogy subtest for the 1929 American Council on Education Psychologi- 
cal Examination; Weisenberg, Roe and McBride (1936) used an analogy test in 
cheir oft-cited study of adult intelligence; and Terman and Merrill (1937) 
included analogy items in the 1937 Revised Stanford-Binet Test. Spearman 
(1923) identified analogies as the exemplification of his theory of intelli- 
gence (later studies were to show analogies as one of the best representations 
of £). Finally, the analogy test emerged as a measure in its own right with 
development of the Miller Analogies Test (Miller, 1926), the Minnesota Psycho- 
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Analogies (Levine, 19 ) and the Minnesota Engineering Analogies Test 
(Dunnette, 1956). A check of the Seventh Mental Measurements Yearbook 
(Buros, 1972) shows that analogies are used in the following tests: 
A.C.E.R. General Ability Scales, Carlton Intelligence Tests, the Scholas- 
tic Aptitude Tests (SAT), the Academic Ability Tests (AAT) , the School 
and College Ability Tests (SCAT), the Gilliland Learning Potential Exam- 
ination, the Safran Culture Reduced Intelligence Test, the Schubert Gen- 
eral Ability Battery, the Verbal Tests, and the Wesman Personnel Classifi- 
cation Test. 

For all its success as a measure of final intelligence and as a pre- 
diction of scholastic and occupational performance, reasoning by analogy 
failed to attract the attention of students of psychological process. Lit- 
tle mention of it is made by cognitive psychologists, although one could 
point to Piaget's (Inhelder and Piaget, 1958) study of formal reasoning as 
coming very close. This review is intended to illuminate, insofar as it is 
possible, this little-known corner of the psychological domain. The review 
comes in three parts: the first traces the origins of analogy in mathe- 
matics and philosophy; the second summarizes psychological theories about 
analogical thinking or analogical reasoning; and the third reviews the 
literature on analogy as psychological test. 

Analogy in Mathematics and Philosophy 

"Analogy" was originally a Greek term which, according to the defini- 
tion given by Aristotle, was used to signify proportionality. "For analogy 
is an equality of proportions, and involves at least four terms... when the 
second is related to the first as the fourth is to the third" (Aristotle in 
Metaphysics) . The historical account below derives largely from Lyttkens 
(1952). 



The theory of mathematical proportions was reputedly first propounded 
by Pythagoras, who in turn was supposed to have learned it from the Babylo- 
nians* Archytas, a contemporary of Plato, regarded analogy as requiring a 
"mean" or "middle term,'* that is, a middle number between two numbers so as 
to construct a series. He differentiated three kinds of mathematical analo- 
gy; the harmonic, the arithmetical, and the geometrical. 

The harmonic analogy stemmed from the Pythagorean discovery of musical 
harmony and required "a given number which by the same part is as much larger 
than another as it is itself smaller than a third" (Lyttkens, 1952, p. 16). 
For example, 4 would be the harmonic "mean" of 3 and 6 because 
3 + (1/3 X 3) = 6 - (1/3 X 6). The harmonic analogy would then read 3:4: :4: 6. 
(Compare this with the contemporary definition of harmonic mean, which is 
H = n / Z (1/x).) 

An arithmetical analogy was constructed by finding a given number be- 
tween two numbers such that the distance from the given number to the first 
was the same as the distance to the second, thus 3:4: :4: 5 or 2:4: :4: 6. 
Proportionality, therefore, in arithmetical analogy was expressed in terms 
of equal distances. (Again, compare this definition with the well-known 
contemporary definition of an arithmetic mean, x = Zx/n.) 

Finally, the geometrical analogy was discovered in connection with the 
discovery of irrational numbers, which the Pythagoreans represented by geo- 
metrical figures. The theory of proportionality was used to relate irratio- 
nal numbers to rational numbers, as for example, lijliijl:!. (Once more, 
compare with the contemporary definition of geometric mean, 

v/^1 ^2 ^ * * ' Whereas in arithmetical analogy proportionality 

was founded on equal intervals or equal distances, in geometrical analogy 
proportionality was based on equality of ratios. In all three cases -- 



harmonic, arithmetical, or geometrical analogy was determined by a like- 
ness of relation, that is, the analogy held if the relation between two num- 
bers (terms) in the first pair was the same as that between the two numbers 
(terms) in the second pair. The original conceptualization involved the 
search for a "middle term" with which to construct a series of three (numbers 
or terms). This was later extended, specifically in geometrical analogy, to 
the construction of a scries of four (numbers or terms). Thus by Aristotle's 
time, analogy meant "an equality of proportions" involving four terms such 
that "the second is related to the first as the fourth is to the third." 

The utility of analogy, especially, geometrical analogy, in linking 
diverse fields such as rational and irrational numbers attracted the attention 
of philosophers. The writings of three in particular are worth noting: those 
of Plato, Aristotle and Aquinas.. 

Plato was the first to use the notion of analogy in philosophy, quite 
apart from its mathematical usage. Analogy was used by Plato to designate 
(a) relations between the cosmic elements, (b) similar relations between 
different kinds of knowledge or spheres of reality, (c) similarity in the 
function of two things, and (d) the nature of certain concepts as logically 
defined through certain real likenesses in relations. As examples: (a) in 
attempting to relate the two fundamental elements of earth and fire, Plato 
used the following analogies fire : air : : air : water, and, 
air : water :: water : earth; (b) in his theory of knowledge, Plato used the 
following analogies — being : becoming :: knowledge : perception, and 
images : ideas :: perception : intellect; (c) in describing the function of 
"the good" as the cause of "being" and "intelligible knowledge," Plato used 
the analogy of the sun in its function as the cause of "becoming" (the sun 
is the source of light and therefore of vision) and of "material knowledge"; 



and (d) in defining "justice" Plato made use of the idea of proportional 
("analogical") equality, i.e. "to give in each case 'what is naturally 
equal to unequals'»" 

Aristotle (Owens, 1951) carried Plato s use of analogy a bit further* 
For example: (a) In his biological classification, analogy of structure 
and function was used to group different genera into larger categories; 
(b) In hi? ethics (Joachim, 1951), analogy (the determination of the 
"mean" or a middle term in a:b::b:c) was used to define "virtue". (Arith- 
metical analogy defined "objective" virtue and geometrical analogy defined 
"subjective" virtue. "Virtue" to Aristotle was the "mean" between extremes. 
Objectively, virtue was equidistant from the extremes, but subjectively, it 
was not necessarily so, i.e., proportionality rather than equidistance was 
the determining factor in subjective virtue.) Similarly, analogy was used 
to define "justice," with arithmetical (equidistant) analogy providing the 
definition of justice between equals, and geometrical (proportional) analo- 
gy defining justice between unequals; (c) In his metaphysics, analogy was 
used by Aristotle as a principle or method of knowing. Such concepts as 
"form", "matter"., "actuality", "potentiality", are equivocal when applied 
to specifics and can only be known by analogy (Owens, 1951, p. 59). In this 
usage, Aristotle broke new grourd. Where previous usage held closely to the 
mathematical meaning of analogy (i.e. the analogical relation said nothing 
about the terms and was univocal, e.g. double is double, whether it be 
120/60 or 4/2), Aristotle utilized the terms to develop the meaning of the 
relation (or concept, such as "form"), then used the relation to help expli- 
cate the terms. 

By Aquinas' time, analogy had become an important tool in metaphysics 
(Lyttkens, 1952; Klubertanz, 1960). Specifically, analogy as a way of know- 



ing was used to attack the problem of unity vs. multiplicity and the prob- 
lem of the status of knowledge of God. A variety of meanings of analogy 
were discerned in the various analyses of Aquinas' texts. Analogy as pro- 
portionality, for example, was discussed by Aquinas in at least five dif- 
ferent senses: proportionality as transfer (e.g. of corporeal attributes 
to an incorporeal God), as parallel predication (as in typical usage), as 
a description of similar functions (similar to one of Aristotle's usages), 
as a description of parallel relationships (as in Aristotle's four-term 
usage) and as proper proportionality between God and creatures (to explain 
the similarity of God and creatures) (Klubertanz, 1960). Much of this dis- 
cussion appears to have little relevance to the psychological understanding 
of analogy or analogical reasoning. 

Analogy in Psychological Theorizing 

As shown earlier, analogy, or analogical reasoning, has seen wide usage 
in the field of intelligence testing. However, as an object of study in its 
own right, analogy (analogical reasoning) has not attracted much attention 
among psychologists. Few of the major psychological theorists have discussed 
analogy. The views of four — Spearman, Thorndike, Guilford and Piaget — 
are presented below. In point of time, Spearman antedates the rest, and 
interestingly, his theory of intelligence is best represented by the structure 
of analogy. His views are discussed first. 

Spearman was already well-known for, among other things, bis two-factor 
theory of intelligence when he wrote The Nature of Intelligence and the Prin- 
ciples of Cognition (Spearman, 1923, 1927). In this work he attempted to re- 
duce (or in another way of speaking, to construct) a psychology of cognition 
to (from) ''ultimate laws" (''genuine principles"). Spearman advanced three 
such principles: 
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(a) the apprehension of experience ("Any lived experience tends to evoke 
immediately a knowing of its characters and experiences/*); 

(b) the eduction of relations ("The mentally presenting of any two or 
more characters tends to evoke immediately a knowing of relation between 
them/'); and 

(c) the eduction of correlates ("The presenting of any character together 
with any relation tends to evoke immediately a knowing of the correlative 
character."). 

According to Spearman, all cognitive growth starts with the first prin- 
ciple and is capable of infinite augmentation by virtue of the second and 
third principles. 

Of interest to this paper is the fact that Spearman used the analogy 
test item as a paradigm for his theory. An analogy has four elements (called 
"fundaments" by Speaman, following ancient usage) organized in a series for- 
mat that is well-known, viz., a:b::c:d. The first Spearman principle requires 
the apprehension of each fundament (cognizing its character). Having appre- 
hended two fundaments, a and b, relation p is educed according to the second 
Spearman principle. Likewise, fundaments c and d are apprehended and relation 
q (between c and d) is educed. Since relations themselves can become funda- 
ments, a second-order relation r is educed from relations p and q. Now, if 
fundament d were missing and relation p were stipulated to be identical with 
relation q, i.e. p is the same as q, then :he missing fundament d can be 
educed as a "correlate" according to the third Spearman principle. 

The three principles may be diagramed in this manner (following Spearman) 





□ 



Principle 1 



Pvinciple 2 



Principle 3 



ERIC 
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From the preceding, it can be seen that three steps (corresponding to 
Spearman's three principles) are necessary in the solution of an analogy test 
item of cha form a:b::c:? 

1. The subjecr must first apprehend (cognize) fundaments a, b, and c; 



to fundament b); 

3. The subject then introduces relation p into the second pair of funda- 
ments and, from fundament c and relation p, educes the missing cor- 
relate, fundament d. 

Spearman helpfully delineated the "range of relations" available to the 
eduction process. Defining "relation" as "any attribute which mediates be- 
tween two or more fundaments" (p. 66), he distinguishes three broad classes: 
real, ideal, and rational. "Real" and "ideal" relations both have existence 
in the related fundaments but differ in "order" (i.e. the "real" order vs. the 
"ideal" order, or "reality" vs. "ideality"). In contrast, "rational" rela- 
tions do not have any such existence but "only spring from particular cogni- 
tive operations upon <the fundaments)". 

Relations listed by Spearman as "real" include: 



2. 



Next, the subject must educe relation p (wh^^'^ r 



fundament a 



(1) 



attribution — the relation of a character to its fundament 



(e.g. of redness to the thing which is red); 



(2) 



identity — the relation of remair ^ the same in spite of 



change in character; 



(3) 



time — the relation of sequence; 



(4) 



space — the relatir... of position; 



(5) 



cause — a relation \vhich, according to Spearman, has been 



subjected to too much unfruitful speculative controversy 



and too little genuine experimental research; 
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(6) objectivity— "particularly difficult relations which derive 
from, or are essentially superimposed upon, mental objecti- 
vity" (another area identified by Spearman as badly in need 
of research); and 

(7) constitution— a relation of which the two fundaments are con- 
stituent parts. 

"Ideal" relations as listed by Spearman include: 

(1) likeness (as well as opposites); 

(2) evidence— the relation of evidence (not cognizing relations 
by evidence: Spearman); 

(3) conjunction; and 

(4) intermixture (i.e., a mixture of the 10 preceding classes 
of relation). 

These eleven types of relations are discussed by Spearman in some detail. 
However, no further mention of "rational" relations occurs. 

The rest of Spearman's work was devoted to an elaboration of a psychology 
of cognition. The three principles discussed above, which are epitomized in 
the analogy test item, were characterized by Spearman as "qualitative", there- 
fore requiring supplementation by "quantitative" principles. Furthermore, 
Spearman asserted that the "quantitative" principles were capable of physio- 
logical explanation, but not the "qualitative" principles. It was to the mani- 
festations o. the three "qualitative" principles that Spearman proposed to 
limit the designation of the term "intelligence". 

Thorndika (Thorndike, et al.,1927) advanced a theory of "intellect" (he 
used this word synonymously with "intelligence") which anticipated Guilford's 
Structure of Intellect. Intellect, according to Thorndike, could be defined 
satisfactorily "only by a list of the products which it produces— the tasks 
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which it achieves." The nature and extent of intellect as revealed in its 
products depended, in turn, on the "content or material operated on." Among 
the content favored by psychologists, Thorndike noted, were words, numbers, 
space-forms and pictures; content that was neglected included three-dimen- 
sional objects and "situations containing other human beings. ' (Only Thorn- 
dike, of all theorists of intelligence, had a concept of "social intellig' ..ce.") 
In constructing a measure of intellect, Thorndike would apply a wide variety 
of operations such as attention, retention, recall, recognition, selective and 
relational thinking, abstraction, generalization, organization, and inductive 
and deductive reasoning. 

Discussing Spearman's theory under the heading "relational thinking", 
Thorndike agreed that "the appreciation and management of relations" was beyond 
doubt a very important feature of intellect. In developing his concept of 
"intellectual difficulty," he was guided by, among others, the following con- 
siderations: (a) that "responding to relations between objects (was) more 
intellectual than responding to objects"; (b) that "responding to so-called 
subjective or logical relations, such as likeness and difference, (was) more 
intellectual than responding t the sj-called objective relations of space and 
time"; and (c) that organizing several relations to secure a certain result 
was more intellectual than responding to one relation at a time (Thorndike, 
et al., 1927, p. 63). 

Despite the importance he attached to "relational thinking", Thorndike 
warned that perception and use of relations was not all of intellect. "In 
theory, analysis (thirking things into their elements), selection (choosing the 
suitable elements or aspects or relations), and organizing (managing many asso- 
ciative trends so that each is given due weight in view of the purpose of one's 
thought), seem to be as deserving of consideration as the perception and use of 
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relations (in defining intellect)." Moreover, Thorndike very presciently 
added, "wp. need other valuations to decide which are the better relations 
°^ t^he more abstract relations, or the more essential elements, or the 
more sagaciuis s.-lection, or the more consistent organization, or the more 
desirable balance.." (Thorndike, et al., 1927, p. 19-20). 

Guilford's Structure oc Intellect theory is well-knovm (Guilford, 1956, 
1959, 1967, 1971). In this theory, "intellect" is mapped acco-ding to three 
axes or coordinates: operation, content and product. There are five opera- 
tions: Cognition, Memory, Divergent Production, Convergent Production, and 
Evaluation. Four contents are considered: Figural, Symbolic, Semantic and 
Behavioral. Six products ensue: Unit, Class, Relation, System, Transfor- 
mation, Implication. 

According to Guilford's Structure of Intellect, analogy and analogical 
reasoning belong primarily to the class of cognition of relations. A comple- 
tion-type analogy test would tap both cognition of relations and convergent 
production of relations, while a multiple-choice-type analogy test would "load" 
less on convergent production and more on cognition. The most common type of 
analogy test— word analogies — is basically cognition of semanti^ relations, 
while figure analogies would be cognition of figural relations. Guilford 
reports research from the Aptitudes Research Project that shows two separate 
factors for the eduction, respectively, of figural and conceptual (semantic) 
relations (Guilford and Hoepfner, 1971, p. 71). Similar hypotheses in 
"eduction of correlates" factors were initially supported, but subsequent 
data and analyses showed that these ("eduction of correlates") factors were 
really a confounding of convergent production and cognition factors. 
Three Guilford conclusions are of importar ce to this survey: 

1. Different content in analogy tests (e.g. word vs. figure vs. 



-12- 

symbol) tap different ability factors; 

2. Different formats in analogy test; (e.g. completioa vs. 
multiple choice) tap different "mixes" of cognition and 
convergent production factors; and 

3. Analogical reasoning constitutes only a limited portion of 
Che domain of intellect (thus disagreeing with Spearman and 
agreeing with Thorndike on this question). 

It might be noted a^ this juncture that Guilford, like Thorndike before 
him, failed to discuss the question of the types of relations involved in 
analogy tests. Nor did Guilford, like Thorndike before him, shed any light 
on the process of analogical reasoning. Guilford and Thorndike might be said 
to be representative of American psychologists who are more concerned with 
outcomes than with processes. (This American predilection could be said to 
fit in with the well-known American emphasis on practicality, ef fectivenss , 
and usefulness— and American psychologists' preference for behaviorism as 
well.) 

To find a discussion after Spearman of process in analogical reasoning, 
one has to turn to a non-American, the Swiss psychologist Piaget. Piaget 
did not discuss analogy or analogical reasoning as such, but rather the prob- 
lem of proportionality (and the related problem of reciprocity), in connection 
with his studies of formal reasoning. (Actually, it was Inhelder who con- 
ducted experimental studies on the problem of proportionality; but it was 
Piaget who provided the ana.lytical account. See Inhelder and Piaget, 1958.) 

In Piaget 's system, reasoning unfolds in two major stages: a concrete 
reasoning stage, most recognizable between the ages of 7 and 11 years; and a 
formal reasoning stage, which occurs between 12 and 15 years. Initially, it 
was thought (by Piaget) that formal reasoning was simply the culmination of 
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the child *s development in concrete operational reasoning, resulting in the 
emergence of a verb'-.l or propositional logic. But Inhelder's experiments 
showed that propositional logic was inadequate to explain the new structures 
of operations found in the adolescent's thinking. Inhelder found that the 
notions of ratio and proportion were comparatively late acquisitions (at 13 
to 15 years). A good illustration is to be found in the problem of equilib- 
rium in the balance, wherein the child has to discover (i.e. reason to) the 
inverse proportional relation between weight and distance to the fulcrum. 
(The parallelism to the original Grecian mathematical meaning of analogy as 
"mean" is worth noting.) 

Piaget explained the new "structures" in terms of the "four-group", 
or group of four transformations: I (identity), N (negation or inversion), 
R (reciprocal) and C (correlative). (The four transformations are also listed 
as: identical transformation, inversion, reciprocity, and inversion of the 
reciprocal or reciprocation of the inverse.) In the problem of the balance, 
the subject who solves the problem understands: I = to increase simultane- 
ously the weight and distance on one of the arms; N = to reduce the distance 
while increasing the weight, or, diminish the weight while increasing the dis- 
tance, or diminish both; R = to compensate for I by increasing both weight and 
distance on the other arm of the balance; and N to cancel R in the same way 
N cancels I. The subject begins with a global intuition of proportionality 
(which corresponds to a qualitative schema of logical proportions), then passes 
on to more detailed logical proportions and from there to numerical propor- 
tions. This kind of proportional thinking is formally equivalent to logical 
reasoning. 

It remained for another Englishman, Lunzer (Society for Research in Child 
Development, 1970), to show the application of Piaget*s conceptualizations to 
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analogical reasoning (or rather, the application of analogy test items to an 
explication of Piaget's theory of formal reasoning). Using verbal and number 
analogies (number series) constructed to investigate the role of structural 
complexity in adolescent reasoning, Lunzer found (1) that both verbal and num- 
ber analogies required the application of formal reasoning operations; (2) 
that simple analogies as well as more complex ones could not be solved ^by a 
clear majority of the group) before age 11; (3) that the most complex analogies 
used in the experiment could not be solved by a majority of the group until age 
15; and (4) that the principal characteristic of formal reasoning was to be 
found in the need to elaborate second -order relations. That is, according to 
Lunzer, concrete reasoning ended with the determination of first-order rela- 
tions, while formal reasoning required the ability to **educe'' second -order 
relations. Piaget himself stated, "Concrete operations may be called first 
degree operations in that they refer to objects directly. ...(I)t is also 
possible to structure relations between relations, as for example in the case 
of proportions. ...In this sense proportions presuppose second degree opera- 
tions, and the same may be said of propositional logic itself. ...(T)his 
notion of second degree operations. . .expresses the general characteristic of 
formal thou^t..." (Inhelder and Piaget, 1958, p. 254). 

One cannot but remark the striking similarity of these views to those of 
Spearman . 

Analogy in Psychological Testing 

The earliest published use of analogy items in intelligence testing ap- 
peared simultaneously in the work of Burt (1911) in England and that of Wood- 
worth and Wells (1911) in the United States. The latter reported on a subtest 
they called a ''mixed relations'* test as part of a test of logical relations 
(there were nine other subtests such as whole-part, action-agent, etc.). An 
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example of their items was: *'Eye--see Ear — Woodworth and Wells con- 

sidered the "mixed relations" subtest an indicator of "flexibility of mental 
performance." Apparently, the "mixed relations" fom had been used by one of 
the authors in his study of consciousness of relations. Besides descriptive 
statistics, little data were reported for the "mixed relations" subtest. 

It was Burt who brought the term "analogies" into the lexicon of the 
mental testers. The "Complieting Analogies" test was devised by Burt as one 
of several tests of "higher mental processes", (he was especially interested 
in reasoning), for use in a study of children between 11^ and 13^ years of 
age. The item form was intended to tap thinking ("rational inference") in 
terms of "association by similars". According to Burt (1911), the test in- 
volved "more than mere reproduction by similarity; it involved the perception. 
Implicit or explicit, of a relation, and the reconstruction of an analogous 
one by so-called 'relative suggestion'." An example of Burt's items was, 

"Eating : Drinking :: Hungry : ?" (The mathematical notation was ali.o 

introduced by Burt.) 

Burt's findings about his "analogies" test were to be the forerunner of 
numerous similar findings. In his 1911 study, Burt reported a test-retest 
reliability coefficient of .92 for a 100-item test (immediate retest) admin- 
istered to children in groups (classes), but only a coefficient of equivalence 
of .58 for individual administration of two halves of the test. However, the 
correlation between teacher-administered and psychologist-administered group 
test scores was .73. Validity of the test as judged against the criterion of 
teachers' ratings was .52 (N = 60). 

Subsequent investigations replicated and supported Burt's findings. 
Tables 1 and 2 summarize the data from several of these early investigations. 
Table 1 lists the reliability findings, while Table 2 shows the validity find- 



ings. 

Insert Tables 1 and 2 here 
As Table 1 shows, reliability coefficients reported for analogy tests 
are generally high, usually in the .80's and occasionally in the .90^. One 
interesting observation to make about the data in Table 1 is the support for 
Piaget's stages of concrete reasoning (7 - 11 years) and formal reasoning 
(12 - 15 years) to be found in Wyatt's reliability data for 10*, 11-, 12-, 
and 13-year-old girls. Among the plausible explanations for* th^ relatively 
lower reliabilities obtained for 10- and 11-year-olds is th possibility that 
formal reasoning had not as yet made its appearance in most of the children in 
those age groups. 

Table 2 shows the validity coefficients for analogy tests obtained by 
several investigators. These* findings may be summarized as follows: (a) A- 
nalogy test scores correlate significantly with various indicators of intel- 
ligence, such as teachers' estimates, grades, tests of intelligence and vo- 
cabulary tests; (b) Apparently, the analogy tests used in these several studies 
contained a significant verbal factor, as witness correlations with opposites, 
vocabulary, sentence completion and the like; (c) Analogy test scores corre- 
late slightly or not at all with tests of numerical ability and tests of 
perceptual speed and accuracy. 

It might be inferred from these data that analogy tests basically re- 
flect a verbal factor. This conclusion appears to find support in Thurstone's 
classic study of primary mental abilities (Thurstone, 1938) in which he re- 
ported his analogy test as loading .60 on factor V. However, it must be noted 
that Thurstone identified factor V as "evidently logical in character", 
"deal(ing) with ideas", "characterized primarily by its reference to ideas 
and the meaning of words". Thurstone called the factor "verbal relations". 
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being careful to indicate that "still another ""erbal factor involves verbal 
material in a psychologically different manner" (Thurstone, 1930, p. 84) • 

Thurstone's comments are reinforced by Carroll's findings (Carroll, 1942). 
In his factor analysis, Carroll found that the verbal analogies test loaded 
.54 on factor J which he identified as '^reasoning ability" and "the ability to 
handle verbal relations." Carroll also noted that the analogy test loaded 
only .22 on the "verbal" factor, which was defined by vocabulary, word choice 
and phrase completion tests. 

These (Thurstone' s and Carroll's) data strongly support Guilford's inter- 
pretation of the basic factor in analogy tests as the "cognition of semantic 
relations", as well as Spearman's belief that the analogy test format best 
represented his "eduction of relations" and "eduction of correlates". 

Several studies have reported on the influence of certain factors on 
analogy test scores. Burt (1911), the pioneer in analogy testing, examined 
the influence of the following factors: (a) the experimenter's (test admin- 
istrator's) training (a trained psychologist's reliability coefficient, .92, 
was much higher than that of a teacher's, .76); (L) conditions of test admin- 
istration (group testincj was more reliable, .90, than individual testing, 
.58); (c) social status (children of superior social status were superior); 
and (d) sex (no difference between the sexes). 

Burt also attempted to remove the language or word -knowledge factor out 
of his analogies test, recognizing language as an irrelevant source of vari- 
ance. Words requiring specific knowledge were avoided, and problems were 
framed so as to indicate unequivocally to the reasoner a single unambiguous 
word as its solution. Thorndike (1919) resolved the language-factor problem 
in more straight-forward fashion by developing an analogy test with pictures. 
Hebb (1942) revised the Van Wagenen's (1920) analogies used in the Weisenburg, 
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Roe and McBride (1936) study to develop a test "whose upper sensitivity is 
due to something else than vocabulary difficulty." Hebb's revision had the 
additional desirable quality of being administerable as a paper-^and-pencil 
test ("Printed Analogies") or as an oral test ("Oral Analogies"). 

Bickers teth (1917) looked at the effect of practice in analogy test 
performance and concluded that practice did not seem to make much difference 
once the nature of the test was grasped by the subject. 

Few studies have addressed themselves to structural factors in analogy 
test performance. Hamid (1925) conducted an investigation of "some factors 
of effectiveness in mental ("intelligence") tests", among these the "extrin- 
sic" factors of position of the correct answer and the time-limit factor 
(speeded vs. non-speeded administration). He found that the total group 
chose the first alternative most frequently and the last (fourth) alternative 
least frequently, even if the correct answer was located most frequently in 
the fourth position and least frequently in the first. However, he also found 
position-preference differences between bright subjects (their preferences, 
except for the fourth position, conformed proportionally to the frequency of 
placement of the correct answer) and the less bright ("medium" and "dull") 
subjects, who strongly preferred (i.e. chose most frequently) the first alter- 
native. On the matter of the time-limit factor, Hamid found that performance 
was apparently not affected much by whether the subject took the test under 
speeded (timed) vs. non -speeded (untimed) conditions. (Hamid also studied the 
influence of two "intrinsic" factors: "eduction" [i.e. multiple choice] and 
"reproduction" [i.e. completion], concluding that "eduction" produced the more 
reliable test.) 

Ace and Dawis (in press) studied the effects of varying two properties of 
item structure on the item difficulty of verbal analogy items. These proper- 
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ties were: blank position (i.e. whether the missing word was located on the 
a, b, c, or d position of the analogy a:b::c:d) and position of the correct 
alternative (there were five response choices to an item). They found that 
blank position alone did not appear to be a factor, but that position of the 
correct alternative and the interaction of blank position and correct answer 
position were significant factors in determining the difficulty of analogy 
items, especially for easier (difficulty level > .50) items. 

As the preceding citations show, very few studies have been conducted on 
the process by which subjects arrive at their analogies (i.e. how they educe 
relations and correlates) and on the structural properties of the analogy item 
and their bearing on subjects' response. Most of the empirical studies found 
in the literature have been concerned with the usefulness of analogy tests as 
measures of "intelligence" or as predictors of school or job success. It is 
apparent that analogical reasoning per se needs much more study. 

Nevertheless, the analogy item has proven itself as an intelligence test 
item (Pintner, 1923). Analogy items have been used in the Otis (1918), the 
Army Alpha (Yerkes, 1921), in Burt (1924), in Spearman (1925), in the Terman 
Group Test (Freeman, 1950), in the Yerkes-Bridges-Hardwick Point Scale (Free- 
man, 1950), in the ACE Psychological Examination and in the C.E.E.B. Aptitude 
Tests (Mager, 1950), in the New York State Scholarship Examination (Brownstein 
6e Weiner, 1964), in the Armed Forces Test and the Service Academy Admission 
Tests (Turner, 1965, 1967). Tests consisting solely of analogies include: 
Burts Mixed Relations Test (1911), Greys Analogy Test (El Koussy, 1934), the 
Miller Analogies Test (1926- ), the Psycho-Analogies (Levine, 19 ) and the 
Minnesota Engineering Analogies Test (Dunnette, 1956). Of these, the Miller 
is best known. 

The Miller Analogies Test is a particularly good example of the analogy 
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test as a selection instrument, with reliabilities of .92 and higher for in- 
ternal consistency reliability and .83 and higher for equivalent forms reli- 
ability. The Miller is a much used instrument for selection of graduate 
students. Average validity coefficients (against grades or comprehensive 
examinations) range from .35 to .55. Correlations with other mental ability 
tests are high (e.g. .80 against GRE Verbal, .82 against the Ohio State Uni- 
versity Psychological Examination, and .73 against the Terman Concept Mastery 
Test). Doppelt (1951) found that while science majors did considerably better 
than non-science majors on "science" items (analogies using scientific terms), 
science majors also did better on "non-science" or "humanities" items, in- 
directly showing that specialization in a field does not necessarily confer 
an automatic advantage to such individuals on Miller items relating to that 
field* Doppelt concluded that it was the perception of relationships which 
was crucial to the solution — and functioning — of analogy items. 

In summary, the psychometric literature is replete with evidence con- 
cerning the usefulness of the analogy item as an intelligence test item. 
Yet few studies can be found on the structural characteristics of the analogy 
item and fewer still on the process of reasoning by analogy. Certainly, if 
the philosophers (and some psychologists) are to be believed--that reasoning 
by analogy constitutes one of the most important modes of human thinking — 
this field bears cultivating. 
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Table 1 

Reliability of analogy test scores, by investigator 



Investigator N Sample 



n items Type of coefficient 



tr. 



Burt 
(1911) 



60- 11%-1?^ year-old 
75 children 



100 



Wyatt 
(1913) 



34 11-13 year-old 
children 



Otis 
(1918) 



total= 10 year-old girls 
409 girls 

11 year-old girls 

12 year-old girls 

13 year-old girls 
121 Grade 4-8 children 



Van Wagenen 150 high school 
(1920) sophomores 



Schneck 210 18-21 year-old 

(1929) college students 



24 



75 



300 



test -ret est (same 
administrator) 

test-retest (different 
administrator) 

equivalent forms 



equivalent 
equivalent 
equivalent 
equivalent 
split-half 
equivalent 
equivalent 



forms 
forms 
forms 
forms 

forms 
forms 



equivalent forms 
split-half 



. 92 

.73 

.92 

.35 
.62 
.78 
.76 
.73 
.84 

.83 to 
.89 

.96 

.88 
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Table 2 



Investigator 



Burt 
(1911) 



Validity of analogy test scores, by investigator 
N Sample n it 



Wyatt 
(1913) 



60- Ilh-I2h year-old 
75 children 

34 11-13 year-old 
children (I) 

Al 10-12 year-old 
girls (II) 



King 6c 276 women university 

M'Crovy (1918) students (W) 

268 men university 
students (M) 



ERJC 



100 



Correlate 


r 


teachers' ratings 
of intelligence 


.52 


teachers' estimates 
of intelligence 


.80 (I) 
.62 (II) 


completion 


.85 (I) 
.58 (II) 


part-whole 


.67 (I) 
.54 (II) 


word-building 


.65 (I) 
.54 (II) 


missing digits 


.61 (I) 
.54 (II) 


sentence construction 


.63 (I) 
.39 (II) 


erasure (As, Ns , Os , Ss) 


.54 (I) 
.14 (II) 


erasure (Es, Rs) 


.43 (I) 
.19 (II) 


opposites 


.52 (W) 
.77 (M) 


completion 


.46 (W) 
.58 (M) 


arithmetic accuracy 


.22 (W) 
.18 (M) 


arithmetic speed 


.17 (W) 
.04 (M) 


logical memory 


.32 (W) 
neg (M) 


information 


.28 (W) 
neg (M) 


visual imagery 


.20 (W) 
neg (M) 



Table 2 (continued) 
Validity >f analogy test scores, by investigator 



Investigator N 


Sample 


n items 


Correlate 














total score (average) 


.72 


(W) 












.74 


(M) 










university grades 


.14 


(W) 












.40 


(M) 




Otis 29 


Grades 4-8 


24 


composite score 


,94 






(1918) 




















mental age 


.97 












(o taniora-Dinet ; 








Baum, Litch- 31 


college seniors 




oppos ites 


.40 






field & 














Wasnburn ^lyiy; 






academic rank 


• jy 






Colvin 


university students 


1 n 


1st semester 


• Dl 






(1919) 






grades 








Pintner & 52 


2nd -year college 


200 


Otis, Form A 


.79 




• 


Renshaw (1920) 


students 












Carothers 


college students 




oppos ites 


• Of 






(1921) 




















completion 


• 4o 






Scnneck zlU 


iJ5-zi year-old 




oppos ites 








(1929) 


college students 


















vocabulary 


.69 












sentence completion 


.45 












disarranged sentences 


.29 












arithmetic reasoning 


.25 












number series 


.17 












equation relations 


.05 












multiplication 


.04 




r 








age 


-.17 
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Table 2 (continued) 
Validity of analogy test scores, by investigator 
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r 

Investigator N Sample n items Correlate xy 

Carroll 119 college students 56 morpheme recognition .56, 

(1942) -55, .50 

disarranges sentences .48 

inventive opposites .42 

vocabulary .42 
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1 Dr. Bernard M. Bass 

University of Rochester 
Management Research Center 
Rochester, NY 14627 

1 Dr. Kenneth E. Clark 
University of Rochester 
College of Arts and Sciences 
River Campus Station 
Rochester, NY 14627 

1 Dr. Robert Dubin 

Graduate School of Administration 
University of California 
Irvine, CA 92664 

1 Dr. Marvin D. Dunnette 
University of Minnesota 
Department of Psychology 
Elliott Hall 
Minneapolis, MN 55455 

1 ERIC 

Processing and Reference Facility 
4833 Rugby Avenue 
Bethesda, MD 20014 

1 Dr. Victor Fields 

Department of Psychology 
Montgomery College 
Rockville, MD 20850 

1 Mr. Paul P. Foley 

Naval Personnel Research and 

Development Laboratory 
Washington Navy Yard 
Washington, DC 20390 



1 Dr. Robert Glaser 

Learning Research and Development Center 
University of Pittsburgh 
Pittsburgh, PA 15213 

1 Dr. Albert S. Glickman 

American Institutes for Research 
8555 Sixteenth Street 
Silver Spring, MD 20910 

1 Dr. Duncan N. Hansen 

Center for Computer -As sis ted Instruction 
Florida State University 
Tallahassee, 32306 

1 Dr. Richard S. Hatch 

Decision Systems Associates, Inc. 
11428 Rockville Pike 
Rockville, MD 20852 

1 Dr. M. D. Havron 

Human Sciences Research, Inc. 
Westgate Industrial Park 
7710 Old Springhouse Road 
McLean, VA 22101 

1 Human Resources Research Organization 
Division #3 
Post Office Box 5787 
Presidio of Monterey, CA 93940 

1 Human Resources Research Organization 
Division #4, Infantry 
Post Office Box 2086 
Fort Benning, GA 31905 

1 Human Resources Research Organization 
Division #5, Air Defense 
Post Office Box 6057 
Fort Bliss, TX 79916 

1 Library 

HumRRO Division Number 6 

P. 0. Box 428 

Fort Rucker, AL 36360 

1 Dr. Lawrence B. Johnson 

Lawrence Johnson and Associates, Inc. 
2001 "S** Street, NW 
Suite 502 

Washington, DC 20009 



1 Dr. Norman J. Johnson 

Associate Professor of Social 
Policy 

School of Urban and Public Affairs 
Carnegie-Mellon University 
Pittsburgh, PA 15213 

1 Dr. Roger A. Kaufman 

Graduate School of Human Behavior 
U.S. International University 
8655 E. Pomerada Road 

1 Dr. Frederick M. Lord 

Educational Testing Service 
Princeton, NJ 08540 

1 Dr. E. J. McCormick 

Department of Psychological Sciences 
Purdue University 
Lafayette, IN 47907 

1 Dr. Robert R. Mackie 

Human Factors Research, Inc. 
Santa Barbara Research Park 
6780 Cortona Drive 
Goleta, CA 93017 

1 Mr. Luigi Petrullo 

2431 North Edgewood Street 
Arlington, VA 22207 

1 Dr. Robert D. Pritchard 

Assistant Professor of Psychology 
Purdue University 
Lafayette, IN 47907 

1 Psychological Abstracts 

American Psychological Association 
1200 Seventeenth Street, NW 
Washington, DC 20036 

1 Dr. Diane M. Ramsey-Klee 
R*K Research & System Design 
3947 Ridgemont Drive 
Malibu, CA 90265 

1 Dr. Joseph W. Rlgney 

Behavioral Technology Laboratories 
University of Southern California 
3717 South Grand 
Los Angeles, CA 90007 



ERLC 



1 Dr. Leonard L. Rosenbaum, Chairman 
Department of Psychology 
Montgomery College 
Rockville, MD 20850 

1 Dr. George E. Rowland 
Rowland and Company, Inc. 
Post Office Box 61 
Haddonfield, NJ 08033 

1 Dr. Benjamin Schneider 
Department of Psychology 
University of Maryland 
College Park, MD 20742 

1 Dr. Arthur I. Siegel 

Applied Psychological Services 
Science Center 
404 East Lancaster Avenue 
Wayne, PA 19087 

1 Dr. David Weiss 

University of Minnesota 
Department of Psychology 
Elliott Hall 
Minneapolis, MN 55455 

1 Mr. Edmond Marks 
109 Grange Building 
Pennsylvania State University 
University Park, PA 16802 

1 LCOL Austin W. Kibler, Director 
Human Resources Research Office 
ARPA 

1400 Wilson Boulevard 
Arlington, VA 22209 



